Effective Theories for Circuits and Automata 
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Abstracting an effective theory from a compiicated process is centrai to the study of complexity. 
Even when the underlying mechanisms are understood, or at least measurable, the presence of dissi- 
pation and irreversibility in biological, computational and social systems makes the problem harder. 
Here we demonstrate the construction of effective theories in the presence of both irreversibility and 
noise, in a dynamical model with underlying feedback. We use the Krohn-Rhodes theorem to show 
how the composition of underlying mechanisms can lead to innovations in the emergent effective 
theory. We show how dissipation and irreversibility fundamentally limit the lifetimes of these emer- 
gent structures, even though, on short timescales, the group properties may be enriched compared 
to their noiseless counterparts. [Appearing in Chaos Special Issue on Randomness, Structure and 
Causality, ed. Jim Crutchfield and Jon Machta. Chaos 21, 037106 (2011)] 



Many systems, especially those with large num- 
bers of underlying degrees of freedom, are best 
described by what are known as effective theories. 
These theories allow us to describe the relevant 
high-level phenomena while remaining ignorant, 
or at least agnostic, about the fine-grained details 
of a system's state. Here, we show how to con- 
struct effective theories of phenomena that may 
show irreversibility or dissipation, a question par- 
ticularly relevant for biological, social and compu- 
tational systems. We use a hierarchical decom- 
position technique from semigroup theory that 
allows one to take finite state automata (stan- 
dard, if restricted, models of computation) and 
determine the irreducible components of the pro- 
cess. Truncating the hierarchy provides an ef- 
fective theory. We study how different under- 
lying mechanisms lead to qualitatively different 
effective theories, and show how noise and irre- 
versibility interact to produce new computational 
phenomena on short timescales, which, in the 
presence of irreversibility, eventually dissipate at 
longer intervals. 



I. INTRODUCTION 

Natural systems usually have at least two layers of de- 
scription. At the lower level is that of mechanism, a de- 
scription of the relevant physical (chemical, biochemical, 
&c.) properties and how they change, deterministically, 
over time: either by laws relating properties, or by laws 
relating probability distributions over properties. This 
lower level need not be completely reduced - for exam- 
ple, the behavioral regularities of a representative person, 
calibrated by laboratory experiments, might provide an 
adequate lower-level theory. 

At a level "higher than" , or above, this description, is 
often an effective theory of the phenomena at hand. The 
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individuals in a crowd follow basic psychological laws, 
say - but the crowd itself shows new properties (perhaps 
density waves, stream-crossings, or a Maxwellian veloc- 
ity distribution.) One sign of a complex system is when 
the higher-level description is not a simple transforma- 
tion of the lower-level description - when the effective 
theory at the higher level is not simply (say) identical 
to that of the lower level dynamics with shifted parame- 
ters. Crowds and swarms may be more, or less, intelligent 
than the individuals that compose them, and may have 
incommensurate abilities. 

The intention here is to demonstrate this phenomenon 
for effective theories of aggregations of Boolean circuits. 
The circuits that form the mechanism level have long 
been models for information processing in natural sys- 
tems [3, 0|, and have been chosen for their familiarity. 
Their directed, acyclic graph structure makes them a 
natural way to describe the basic units of a computa- 
tional process unfolding in time. When noisy operation 
and feedback is allowed, they show dissipative proper- 
ties, and can be described as finite-state probabilistic au- 
tomata. It is in this latter language that we will phrase 
the higher-level effective theory. 

Our choice of probabilistic automata allows the use of 
certain mathematical tools, unavailable in more general 
cases such as computation by a Turing machine, to quan- 
tify the characteristic features of the effective theory. In 
particular, within our construction, "more is different" Q 
can be quantified as the emergence of new, irreducible 
group structures. 

We first consider the non-probabilistic case. We briefly 
describe how circuits with feedback are qualitatively dif- 
ferent from the acyclic case, and then introduce the fi- 
nite state automata. We then show how automata can 
be wired together, or composed, in an operation anal- 
ogous to the interconnection of gates. We introduce a 
crucial theorem, the Krohn-Rhodes decomposition, and 
show how it relates to the underlying structures of the 
Boolean circuits the automata describe. 

This will give us the necessary framework to show the 
emergence of effective theories in non-probabilistic sys- 
tems. In particular, it will allow us not only to decompose 



theories so that they might be compared to each other, 
but also to show how they can be coarse-grained It 
is this coarse-graining process that allows us to define 
effective theories and to fairly compare the properties 
of microscopic and macroscopic dynamics; it provides a 
smoothed, lower-dimensional, computational process. 

We then show how these results can be extended to 
the probabilistic domain. We show how to separate the 
random and non-random components of such a system. 
This provides a solvable decomposition of the most gen- 
eral probabilistic computation - the "Bernoulli Turing 
Machine" Q . Formally, the introduction of probabilistic 
behavior leads to a non-random component with more 
complicated group structures and the possibility of both 
irreversibility and dissipation. Transient behavior may 
be associated with larger group structures than the cor- 
responding noiseless machine. However, this window fi- 
nally closes, and the long-timcscale effect of noise is to 
destroy all these structures, including those of the noise- 
less counterpart. 



II. FROM CIRCUIT TO AUTOMATON 

Logical circuits - compositions of basic operations 
(gates) such as AND, OR and NOT - are a natural way 
to represent information processing and computation in 
natural systems [B-Q- 

For the case of Boolean functions without feedback, 
their algebraic properties are particularly clean, and pro- 
vide a handle on how new functional classes emerge on 
composition. For example, AND and OR together can only 
represent a fraction of all possible functions, while NAND 
or NOR alone can cover the entire space. The full de- 
scription of these relations is the Post lattice [l(| EH, 
which shows how functional classes implemented by dif- 
ferent combinations of fundamental gates (logical bases) 
enclose or are enclosed by others. 

Because their underlying structures are directed, 
acyclic graphs, they can also be seen as descriptions of 
causal processes, in the manner of Pearl's causal net- 
works [l2|. The classes that make up the Post lattice 
then amount to different ways of partitioning the space 
of causal processes - once any loops are "unrolled" so as 
to eliminate cycles. 

In many cases, however, one wants a simultaneous ac- 
count of causality and feedback (or self-action, joint reg- 
ulation, and so forth.) The extension of Boolean circuits 
to this case is natural - one simply takes outputs from 
later in the process, and connects them to inputs up- 
stream. This is often described using the formalism of 
logical nets (see, e.g., Ref. [H[); Fig. [1] shows two exam- 
ples of the particular cases we will examine; the different 
ways a limited number of logical gates can be combined 
are the structures we associate with the mechanism layer. 

The seemingly minor change of allowing feedback leads 
to - among other things - an uncountably infinite num- 
ber of "prccomplcte" classes (i.e., classes just short of full 
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FIG. 1. Boolean functions on the two and three-bit register. 
At each time step, the device moves one step to the right, 
inducing feedback. These machines can be identified with 
logical nets; the acyclic graphs that compose them are the 
fundamental mechanism in our demonstration. 




(a) 




(b) 



FIG. 2. Left: the two-bit left-shift automaton. Right: the 
XOR function, i, — > ti-2 XOR ti-i, corresponding to the top 
mechanism of Fig. [l] 



coverage of the space of all feedback functions) [13, Il4[ . 
The breakdown of the classification by logical nets leads 
us to formulate a higher-level theory in terms of finite 
state automata (TB]. We introduce these machines, and 
some of their mathematical properties central to our dis- 
cussion, in the next section. 



III. AUTOMATA AND SEMIGROUPS 

We consider first the non-probabilistic case. The sim- 
ple deterministic (l6| automaton wc define by the tuple 
(S, Q, <5, go), where E is the input alphabet, Q the set of 
internal states and 6 : E x Q — > Q, a map from the cur- 
rent state and the current input letter to a subsequent 
state - S(s,q) = q' means that when the automaton is 
in state q and receives the input letter s (in E) it will 
transition to state q' . 

The state qo is the initial state of the system; since we 
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will be concerned with processes that run forever, and not 
with the language-recognition properties of automata, we 
will not define terminal states. 

An important case for the description of natural sys- 
tems is when the input alphabet has only one element. 
This single-letter environment amounts to a "passage of 
time" operator, advancing the system from one state to 
the next. In other cases, different letters in the input 
alphabet will amount to different environmental signals, 
altering the transitions the system makes between states. 

The other important structure for our analysis is the 
semigroup. A semigroup is a set S of elements that can 
be "multiplied" together to produce other elements in 
the set. Multiplication is associative and a ■ (b • c) gives 
the same result as (a ■ b) ■ c. In some cases, a semigroup 
will have an identity element, i - for any element s in 
the semigroup, s ■ l = s — l ■ s. A semigroup with an 
identity element is called a monoid. The differences be- 
tween semigroups and monoids will not be essential in 
our discussion. 

In the case where there are inverses - i.e., when for ev- 
ery element of the set, s, there is another element, s' , such 
that s • s' is the identity l - the semigroup is a group. In 
the physical sciences especially, groups have been used to 
describe symmetries of a system - for example, the group 
of rotations, or reflections, or groups such as hypercharge 
associated with the insensitivity of physical processes to 
internal properties of a particle. Semigroups, we shall see, 
are associated with a wider range of processes, including 
irreversible processes fl7j where there is no inverse oper- 
ation that takes everything back to a prior state. 

The free semigroup on a letter, or set of letters, is de- 
fined as the set of all compositions of the letters - for 
example, the free semigroup on E = {a} is the (infinitely 
large) set {a,aa,aaa,aaaaa, . . .}; this is often denoted 
E + . By identifying the results of different compositions, 
one produces smaller, often finite, semigroups. For ex- 
ample, by setting aaaa equal to a, one gets the monoid 
M consisting of {a,aa,aaa}, where aaa now appears as 
the identity element. Note that in this case, M is also a 
group - the inverse of a is aa, the inverse of aa is a, and 
aaa is its own inverse - and is called the cyclic group of 
order three; it counts inputs modulo three, and is written 

z 3 . 

Another important semigroup is the full transition 
semigroup on n states. It is the largest semigroup on 
n states, and has n™ elements, each of which amounts to 
a map from the set of states to itself. Included in the 
full transition semigroup are all of the permutations of 
the set, as well as the "irreversible" operations that may 
map many inputs to the same element. 

The correspondence between finite state automata and 
semigroups (i.e., groups with neither inverses nor an 
identity element) allows one to draw on the tools of ab- 
stract algebra. Consider the automaton (E, Q,5, qo). A 
string of input letters is a member of E + . The transi- 
tion function 5 can be extended to accept elements of 
E + in the natural manner - by definition, any s G E + 



is a string ,si,S2 ■ • ■ s n , with each Sj in E. Then, S(s,q) 
is 5(s n , . . . 5(s2, S(s±, q)) . . .) - i.e., the state you end up 
in after receiving s\ in state q, going to the new state 
S(si,q), receiving letter S2, and so forth. 

Given this extension of S, we define an equivalence re- 
lation, =, on members of E + by 

a = b if and only if 6(a, q) = S(b, q) Vq <E Q. (1) 

In other words, two members of E + are equivalent if and 
only if they have the same effect on the automaton re- 
gardless of the state the automaton begins in. This struc- 
ture is called the transition semigroup, and makes the 
correspondence between automata and semigroups com- 
plete. 

Semigroups often have subsets that turn out to be 
other semigroups, or even groups. Note that for a sub- 
set S' of a semigroup S to be a semigroup, it has to be 
closed under multiplication - in other words, multiplying 
together any two elements of S' has to give you another 
element in S' . The monoid M, above, has no non-trivial 
subgroups (or subsemigroups.) 

Fig. [5^ shows a more interesting example: the "left- 
shift" automaton that has an input alphabet S = {0, 1}, 
and four states. This machine describes a system with 
a two-bit internal register, that processes new elements 
from the environment by shifting the register bits the left 
and appending the input bit. Such a machine does not 
have a group structure: whatever state the system is in at 
time t, after accepting two more inputs, it has completely 
forgotten its prior state. There is no way to undo this op- 
eration, and all past information is erased. The automata 
thus induces a semigroup with four single-element sub- 
semigroups, and no non-trivial subgroups (l8j . 

Fig. [2^ forms a base from which one can define other 
functions. Consider, for example, the process U — ¥ 
tj_2 XOR tj_i. This can be described by a finite state 
automaton whose skeleton is the left-shift semigroup; in 
particular, the input set E is now the one letter passage 
of time operator, and the transition structure, Fig. [2}d, 
chooses for each state one of the two outgoing arrows of 
Fig.[2K- Note that while the left-shift register has no non- 
trivial subgroups, the XOR machine does - in particular, 
syntactic monoid is Z%. 

There are 2^ 2 > single- letter automata that can be de- 
fined on the n-bit left-shift register in this fashion, one for 
each of the possible Boolean truth tables B n —> B. We 
can merge these machines together to produce the left- 
shift powerset automaton with 2^ 2 > input letters, each 
letter referring to a transition implemented by one of the 
single-letter automata. 

The left-shift powerset automaton is much smaller 
than the full transformation semigroup, which has 
(2 n )( 2 ) elements. However, when transitions on the au- 
tomata are composed - i.e., when one compares the semi- 
group of the left-shift powerset with the full transition 
semigroup - then the two are isomorphic. We prove this 
in the Appendix. 
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Aa Ba Aa 

Ba 

FIG. 3. A cascade of two Z2 counters; the lower-level machine 
has two possible transitions, depending on the state of the 
higher-level machine. The cascade now can count modulo 
four, with the high-level machine counting even versus odd, 
and the lower-level machine tracking the second bit. 



IV. AUTOMATA CASCADES 

At the mechanism level in our demonstration, compo- 
sition is simply the wiring together of logical gates in 
structures of increasing complexity, as in Fig. [1] Such 
compositions are relatively simple to understand - one 
connects outputs from one circuit to the inputs of a an- 
other, producing a directed acyclic graph. 

In many cases in both natural and engineered systems, 
we would like our environmental response - the transi- 
tions our machine makes - to be modulated by other 
processes, including other machines. Indeed, the abil- 
ity for one machine to control another seems central not 
only to the notion of computation [l9| , but to collective 
phenomena in general. 

A cascade of automata is a restricted form of such con- 
trol. It is a feed-forward system, with a machine at level 
n receiving a set of letters from the n — 1 machines above 
it, and the environment itself. The machine at the top 
level (level 1) receives only the environmental input s, 
and makes a transition from state q\ to q[; the machine 
at level 2 receives a joint symbol, (s,qi) and makes a 
transition from q 2 to q' 2 ; the machine at level 3 receives 
the triple (3,51,92) and so forth. 

A very simple example of a cascade is show in Fig. El 
Here, two machines, both equivalent to a Z 2 counter, are 
cascaded. The top-level machine accepts a single input 
letter, a, from the environment; the lower-level machine 
receives a joint signal Aa or Ba, depending on the state 
of the machine above. Inspection shows that this cascade 
of two modulo-two counters allows us to count modulo 
four. 

Cascades of automata are essentially hierarchical. Ma- 
chines higher up the chain control more general features 
of the system. They require fewer inputs, and arc igno- 
rant of the finer-scale details of state structures below. 
Their states are effectively superstates - collections of 
states of the equivalent collapsed machine. The top-level 
states A and B of Fig. [3l for example refer to pairs of 
states in the equivalent counter. 

It is in these senses that cascades provide a graded 



set of effective theories. Truncating a cascade at some 
level allows one to "smooth" a complicated, multi-state 
process in a manner consistent with its internal logic. 

Cascades have a particularly special form. In the next 
section, however, we will see that any automaton can 
be rewritten in this way, with each level composed of 
particularly simple subroutines. 



V. THE KROHN-RHODES DECOMPOSITION 

In some cases, as we saw in the previous sections, the 
semigroup associated with an automaton turns out to 
be a group. The Cayley theorem - that all groups are 
isomorphic to subgroups of the permutations - makes 
these automata simple to identify. In particular, for such 
an automaton every transformation induced by a letter 
of S leads to a permutation of the states. 

At the other extreme are the "resets." A letter s in 
S is a reset if it has the same effect on all states - if it 
resets the machine, in other words, to a unique state. 

In between, of course, are operations that permute 
some states and reset others - for example, a letter s 
acting on a subset of states might act as a permutation, 
but on a different set it acts as a reset, taking all elements 
to a single final state. Examples of these mixed machines 
include that of Fig. [SJd. Conversely, "pure" machines - 
those that are combinations of only permutations and 
resets - are called permutation-reset machines. A par- 
ticularly simple example of a permutation-reset machine 
is the flip-flop - a two-state machine with two resets and 
the identity operation. 

The surprising result of the Krohn- Rhodes theorem 0, 
[20j is that any finite state automaton can be decomposed 
into a cascade whose automata contain only the simple 
groups and the flip-flop. This cascade produces behav- 
ior that maps homomorphically onto to the original ma- 
chine [2ll ]. In contrast to Turing-complete processes, one 
can not only can define a "restricted" algorithmic infor- 
mation complexity for the finite state automata by stan- 
dard minimization techniques, but can also break them 
down into a small number of hierarchically organized sub- 
routines. 

Ref. [2(j proved the existence of such decompositions, 
but did not present a simple way to find them. The holon- 
omy decomposition [22h25| provides an efficient means of 
reconstruction; computations in this paper use an imple- 
mentation of the holonomy decomposition in the sgpdec 
package [H-iU in GAP Hg. 

An example of the decomposition is shown in Fig. [4] 
The complicated structure of Fig. [4ji breaks down into 
a three-level cascade. The top level, shown in Fig. QJ) is 
a Z3 counter with a reset; the lower two levels include 
additional Z2 counters. The "superstates" of Fig. [4p are 
not disjoint: all three of the superstates include states C 
and F. 

One of the interesting features of the Krolm-Rhodes 
theorem is the difference in treatment of the reversible 
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a, b 




(a) 




(b) 



FIG. 4. Effective theories and "smoothed" computations, (a) 
An eight-state automaton with two input letters, built from 
XOR gates on the left-shift register, (b) The top level of the 
decomposed machine. Despite the complicated internal struc- 
ture of (a), at the coarse-grained level, the process is seen 
count modulo three (on receiving a signals), and reset (on 
receiving b signals.) Movement within the three superstates 
of (b) is dictated by Z2 counters and resets at lower levels in 
the decomposition. For example, states C and F are shared 
by all three states of the high level theory; transitions to this 
sub-space are described by resets at lower levels. 



(group symmetry) and irreversible transformations of the 
system. While the groups resolve themselves into a non- 
trivial catalog of simple subunits, there are no "irre- 
ducible" semigroups of dissipation beyond the flip-flop. 
There are distinct and irreducible groups of reversible 
computations, but the irreversible aspects of a computa- 
tion decompose finally into collections of pure identity- 
resets. 

We now have all of the necessary tools to demonstrate 
the emergence of incommensurate effective theories in 
non-probabilistic systems. 



VI. EFFECTIVE THEORIES IN 
NON-PROBABILISTIC SYSTEMS 

Fig. [2}d shows the action of an XDR structure on two 
bits. It contains a Z3 counter (as in Fig. [4] the su- 
perstates of the top level overlap.) Such a counter can 
be chained in different ways; with an appropriate choice 
of cascade, it can play the role of a multi-digit trinary 
counter (and similar, degenerate machines.) 

The apparatus of group theory, however, provides a 
clear answer to what the machine can not do and con- 
strains the form of any effective theory built out of 
parallel or serial compositions of these machines. The 
group structures of these new effective theories must be 
(Jordan-Holder) reducible to their constituents. 

By contrast, combinations of gates - as opposed to 
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1 letter 
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1 gate 


Z n =7 
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2 gates 
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4-bit XOR 


1 letter 


2 letters 


1 gate 


Z n =2,3,5 


As 


2 gates 


Z n =7 


PSL(3,2) 


3 gates 




(SV),=3 , 5,6 


4 gates 







TABLE I. The relationship between mechanism, environment, 
and top-level emergent group structures, with increasing com- 
plexity in mechanism (going down the table) and environmen- 
tal diversity (from a singleton environment to a binary sig- 
nal.) Notation: Z n (counters modulo n); A n (the alternating 
groups on n elements); S„ (full permutation group); PSL(3, 2) 
(second smallest non-Abelian simple group after A5.) In many 
cases, these groups appear as semidirect products with other 
groups (not shown on table, for clarity.) A dash indicates 
that no new simple groups appear. 



their induced automata - will not be so restricted, and it 
is these innovations, at the mechanism level, that we will 
be concerned with. In general, combinations of larger 
numbers of circuits, with greater environmental sensitiv- 
ity and over longer histories will naturally produce more 
complicated behavior. 

This is similar to how a collection of n members of a 
crowd will be more complicated than a single individual, 
because one now has to keep track of n times as many 
variables, as well as the combinatorics of their interac- 
tions. However, depending on the nature of the interac- 
tions, the effective theory of such a collection - a theory 
over a set of states comparable in size to that of the orig- 
inal members - may have qualitatively new properties. 
A pair of Z2 counters may be cascaded to count modulo 
4, but the mechanisms underlying those counters may be 
re-wired in such a way to produce a machine with novel 
decomposition. 

The only permutation machines with a single input 
letter - corresponding to groups with a single generator - 
are the counters, and they factor into the cyclic groups of 
prime order (if a machine can count modulo three, copies 
can be chained together in a cascade to count modulo 27 
(3 3 ), but can not count modulo 7, for example.) We will 
see that mechanism-level compositions, by contrast, lead 
to new categories of machine that can count modulo an 
arbitrary number (and whose cascades can do arithmetic 
in an arbitrary combination of bases.) 

New and irreducible effective theories may also arise if 
one allows the machine to discriminate different environ- 
mental states - i.e., if one expands the input alphabet. 
Since many groups have a small number of generators 
(and the simple groups have at most two) one does not 
need a great amount of environmental diversity to realize 
these more complicated structures. 
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We show a specific example of these effects in Ta- 
ble [H where we consider XOR-based mechanisms on three- 
and four-bit registers. In particular, each entry for the 
"1-letter" column in the table shows the new top-level 
groups that are possible by use of at least one of the 
Boolean circuits with the specified number of inputs and 
XOR gates, operating in the left-shift register fashion ex- 
emplified by Fig. [TJ We consider circuits with gates 
of fan-in two and unlimited fan-out, which give a to- 
tal of 610 distinct truth tables found by enumeration of 
the 4643 topologically distinct graphs for the mechanism 
complexities listed in the table. 

The standard left-shift register has a singleton envi- 
ronment - the passage of time operator. In the case of 
the 2-letter environment, one enlarges the systems under 
consideration to pairs of circuits, with two possible in- 
put letters that choose which of the circuit structures to 
implement at each step. 

The composition of increasing numbers of gates leads 
to a number of new and irreducible group structures. Un- 
derlying mechanisms of limited universality (XOR, for ex- 
ample, is not even a complete basis in the Post lattice) 
lead not only to new effective theories, but to a prof- 
ligate number of them, including many near-maximal 
symmetries on the full state set. We show in our ta- 
ble only the simple groups, but in many cases these 
combine in more complicated structures: for example, 
(Z 2 x Z 2 x Z 2 ) x PSL(3,2) can be implemented with a 
pair of circuits, with two gates each, on the 4-bit register. 

Since (as shown in the Appendix) the left-shift pow- 
erset is isomorphic to the full transformation semigroup, 
when all truth tables become accessible (when the un- 
derlying gates are drawn from a complete basis) , then all 
groups become accessible, given sufficient environmental 
diversity and mechanism complexity. 

Complete coverage of the full B n — > B space is not 
necessary to attain the full transformation semigroup. 
For example, even though one requires circuits of at least 
nine NAND gates to cover all 3-bit truth tables, one can 
achieve the full transformation semigroup on eight states 
with mechanisms that need at most only five NAND gates. 

Despite this, such compositions at the mechanism level 
will still become increasingly vulnerable to noise in the 
individual elements of the system. When gates become 
unreliable, undesired transitions may occur, and com- 
positions of gates exacerbate this problem by providing 
multiple failure-points. As we shall see in the next two 
sections, the presence of even a small amount of noise 
leads to an irreversible degradation of the group struc- 
tures of the effective theory. 



VII. PROBABILISTIC AUTOMATA 

The Krohn- Rhodes decomposition applies to determin- 
istic, non-probabilistic systems, and is not immediately 
applicable to situations in which the effect of an input 
symbol is probabilistic. In this section, we show how 



to break up such probabilistic machines into a cascade, 
of a probabilistic process at the top (a "Bernoulli au- 
tomaton"), which feeds a symbol, chosen from a distri- 
bution, to a non-probabilistic automaton beneath. This 
construction was first demonstrated by Ref. [3^] ■ 

An n state probabilistic automaton is defined by 
(£, Q,p, qo), where p : Q x £ x Q — > [0, 1], replaces the 
state transition function. p(qi,s, q 2 ) gives the probabil- 
ity that when the machine is in state q\ , and receives the 
input letter s, it makes a transition to q 2 . The proba- 
bility is normalized so that, for an n state automaton, 

ELi P(l' s > li) is unit y for a11 seT,,qeQ. 

Consider the space of all possible transitions on n 
states - the full transformation semigroup, M. There 
are n n such transitions in the semigroup, which can be 
written as functions m(q). A probabilistic automaton as- 
sociates a probability, ir, with every m, and input letter, 
s, as follows: 

n 

7r(m, s) = Y[p[qi,s,m(qi)]. (2) 

i=l 

In words, the probability of m given s is the product of 
the probabilities that each arrow in the original automa- 
ton corresponding to a is obeyed. 

The decomposition then proceeds as expected. A 
Bernoulli automaton receives signal s from the environ- 
ment, and chooses m £ M according to the distribution 
of Eq. [5] A deterministic machine with the same n states 
as the original probabilistic machine, but which now ac- 
cepts up to n n letters, then executes the transition m. 
This latter machine can be decomposed in the standard 
way. 

As an example, consider introducing noise to the au- 
tomaton of Fig. [2Jd to produce the probabilistic automa- 
ton defined by the truth table [0.5, 1, 1, 0.75] - where the 
numbers now refer to the probability of emitting a one. 
The probabilistic version is shown in Fig. [5^, and the 
structured, non-random part in Fig. [SJx 

Eq.[5]is a very general - but not the only - noise model 
for the kinds of computational process described above; 
it corresponds to the e-independent failure model 0, 
l3l| . Other models are possible, depending on one's 
beliefs about how the computation departs from non- 
probabilistic behavior; we return to this question in 

Sec. us 



VIII. EMERGENCE IN PROBABILISTIC 
SYSTEMS 

The construction of the previous section shows that 
adding probabilistic behavior to a finite state automaton 
generally increases the complexity of the underlying de- 
terministic mechanism. When introducing noise to the 
machine of Fig. to produce Fig. [5^, for example, the 
underlying structure goes from a singleton alphabet to 
a four- letter alphabet, and the holonomy decomposition 
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(a) (b) 

FIG. 5. Decomposition of a (single input letter) probabilis- 
tic automaton into a 4-letter deterministic machine; n(a) = 
tt(c) = 3/8; iv(b) = 7r(d) = 1/8. 

goes from a single Z3 counter to a four-level cascade of 
Z3, Z2 and identity-reset machines. 

In the extreme uniformly-distributed proba- 

bilistic choice over the full transition semigroup is the 
most complex machine - in terms of the size of the ir- 
reducible groups. And yet when coupled to a uniform 
Bernoulli process, it produces a purely random stream of 
numbers. The larger the structure one moves around in, 
the closer one gets to randomness; or, put another way, 
the more features of the environment a machine is sen- 
sitive to, the more random that machine appears when 
the relevant variables are unobserved. 

The generators of the left-shift powerset will in general 
have different probabilities. While it is tempting to de- 
scribe the resulting machine as probabilistic draw of the 
different semigroups (and their Krohn-Rhodes decompo- 
sitions) associated with each single-letter automaton, this 
elides a crucial distinction between the automaton and its 
expansion to the semigroup structure. For example, the 
semigroup associated with the XDR automaton includes 
the cyclic group Z3; however, the "shift by one" and 
"shift by two" elements of that group will have different 
probabilities when noise is introduced, since they require 
different compositions of generators. 

In particular, as the machine unfolds in time, differ- 
ent elements of the semigroup will appear with differ- 
ent probabilities. While the generators arc themselves 
members, other elements of the full transition semigroup 
require multiple compositions, and so the probability dis- 
tribution over the different elements will be a function of 
time. 

The asymptotic distribution depends on the presence 
of irreversible transformations. When resets are present, 
one finds that the limiting distribution is concentrated 
solely at these points. Under the failure model of Eq. [2j 
noisy machines that run for ever forget everything. 

This is most simply visualized as the limit of a ran- 
dom walk on the directed graph of the semigroup, where 
each vertex corresponds to a member of the semigroup 
and each directed edge corresponds to some multiplica- 




Steps 



FIG. 6. The rise, and fall, of group structures in noisy Boolean 
systems. For the XOR function of Fig. 03, with a 1% bit-flip 
rate, we show the probability that the function implements 
one of the group elements of the noise free case (Z3, solid 
line), one of the four reset automata (dotted line), or any 
group element not in Z3 (the set 64 — Z3, dashed line.) The 
light gray line shows the remainder. As time passes and errors 
accumulate, the chances of a transformation being a member 
of Z3 decline, while the reset automata come to dominate the 
long term input-output maps. The non-trivial relationship 
between noise and complexity can be seen when, for a brief 
period, representatives of more complex groups appear and 
even dominate the pure resets. 



tion by an element of the left-shift powerset - this graph 
is analogous to the Cayley graph for groups. Conver- 
gence depends on the details of the noise mechanism, 
but the resets form a strongly connected subgraph that, 
once reached, is never left. 

Noisy automata, then, can show complexity only on 
short timescales. This is shown in Fig.[6l where the shift- 
ing distribution of semigroup structures is shown for the 
noisy-XOR (i.e., the truth table [e, (1 — e), (1 — e), e].) As 
noise increases, the machine becomes less likely to realize 
any element of the Z3 cyclic group. The ultimate limit 
of the process is to end up at the resets. This amounts 
to a forgetting, and a time horizon of complexity. 

For a brief window, members of other groups (elements 
of the set of all permutations, minus the members of Z3) 
appear. These other members are expected, since they 
are included in the left-shift semigroup; however, their 
appearance is only fleeting, and (in this case) never be- 
comes a significant driver of dynamics. The question of 
whether such noise-assisted group structures can become 
significant is open, and may provide insight into the use 
and management of noise in biological systems (see, e.g., 
Ref. [32U37] ; we return to this question in Sec. ITXl ) 

One can now see the two-fold relationship between 
noise and the increasing numbers of group and semigroup 
operations. 

Combining underlying mechanisms in the non- 
probabilistic case leads to a growing diversity of group 
structures; with sufficiently complex environments, and 
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FIG. 7. A rare e-independent noisy automaton, on three bits, 
for which uncorrelated failures do not lead to convergence to 
a collection of resets. Such machines require at least partially 
noise-free behavior at the mechanism level. 



sufficiently large mechanisms, one can instantiate every 
classical and sporadic group known - all the way up to 
the Fischer-Griess Monster Group with 8 x 10 53 states 
(when represented as a transformation group) - but only 
two generators, so that such a group can live in a very 
simple environment indeed! 

As we saw in the previous section, the probabilistic sys- 
tem contains a non-probabilistic submachine with many 
groups far more complicated than those instantiated by 
the corresponding noiseless mechanism. In the exam- 
ples we have seen, however, their appearance is quickly 
overwhelmed by the uninteresting resets. Noise in the 
mechanism leads finally to a decay in the complexity of 
the emergent process. As mechanisms are combined, the 
noise in their resulting function breaks up their structure. 

If the noise has the form of Eq. [JJ can a system put 
zero weight on dissipative structures that combine into 
resets? Even a probabilistic choice on transformations of 
two "counter-rotating" cyclic groups will lead to a reset 
in 7r(m) by Eq. [51 and the presence of an overlapping 
elementary collapsing and permutation are sufficient to 
produce the necessary irreversibility. Examples can be 
constructed where the resets apply only to part of the 
system; Fig.[7]is one. Note, however, that the probabilis- 
tic behavior is confined to a subsystem - and that this 
subsystem converges to a reset. 

This is not, however, the final word, as we shall see in 
the following section, and the nature of the underlying 
mechanism can allow a system to avoid the asymptotic 
fate shown in Fig. [5] 



IX. DISSIPATION, IRREVERSIBILITY AND 
THE VARIETIES OF UNRELIABILITY 

A different way to alter the dissipative nature of noisy 
computation is to depart from Eq. [21 If the noisy mech- 
anism that underlies a finite state machine is interpreted 
as a Markov process, Eq. [2] is a general, but not the only, 
way to separate out the probabilistic behavior from the 
non-probabilistic structure. It contains implicit assump- 
tions about the nature of the mechanism, and examina- 
tion of alternative separations gives insight into the rela- 
tionship between Markov processes and computation. 

For the noisy-XOR machine, with truth table [e, (I — 
e), (I — e), e], Eq. [2] produces a system with sixteen input 
letters. One could, however, imagine a decomposition, 
entirely equivalent if the state diagram of the machine is 
read instead as a Markov process, composed of only two 
letters, a and b. The letter a is drawn with probability 
1 — e, and induces the transformation of Fig.[2p; the letter 
b is drawn with probability e and induces the complemen- 
tary transformation, i.e., that given by the truth table 
[1,0,0,1]. (Other decompositions, with intermediate al- 
phabet sizes, can also be constructed, but we consider 
these two for simplicity.) 

Any particular history of the machine's state transi- 
tions will be consistent with either decomposition. The 
differences emerge when one considers multiple histories 
at once: either by putting multiple pebbles on the ma- 
chine, and moving them according to the transitions in- 
duced by the letters, or by putting the non-probabilistic 
sub-machine in different initial states and starting the 
Bernoulli process with the same "seed." 

When considering multiple histories at once, it is seen 
that alternatives to the decomposition of Eq. [2] amount 
to theories of correlated failures in the underlying mech- 
anism. In the two-letter process, for example, whatever 
glitch occurs affects the output associated with each in- 
put in the same way - by inversion - whereas the 16-lcttcr 
process allows for the possibility of a glitch that flips only 
some of the input-output relations of a process. 

The uncorrelated case of Eq. [2l known as the e- 
independent failure model, is that considered by Ref. [l[ . 
In many cases - such as shot noise in a biomolecular pro- 
cess, thermal noise in a semiconductor, or uncorrelated 
hidden variables in a group decision-making process - 
such an assumption seems warranted. However, in other 
situations, noise properties are correlated, me aning t hat, 
for example, a failure that switches f(x, y) to f{x, y) will 
necessarily switch f(x',y') to f(x',y') as well. 

In general, sources of these restricted processes include 
failures at "high levels" of the mechanism: the code that 
implements XOR is randomly flipped to code that imple- 
ments NOT-XQR. Another possibility is that of shared hid- 
den variables, such that mechanisms that fail in a partic- 
ular fashion in one state necessarily fail in the same way 
in any one of a particular subclass of such states. An ex- 
ample of such correlated noise in biological information 
processing, which could potentially lead to machines vi- 
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FIG. 8. The rise, and fall, of group structures in noisy Boolean 
systems with correlated unreliability as described in Sec. IIXI 
In contrast to the standard, uncorrelated model of failure im- 
plied by Eq.[5]and shown in Fig. EI no irreversible transforma- 
tions appear at all. However, knowledge of which reversible 
transformation the system has undergone becomes increas- 
ingly uncertain, and the distribution of possible transforma- 
tions at long times becomes a uniform distribution over A4, 
a subgroup of the full symmetric group, with elements of Z3 
appearing at the expected frequency of 1/4 (short grey line.) 



dating the implicit assumptions of Eq. [2] is found in 
mammalian motor and cortical neurons, where redun- 
dant signals from upstream processing arrive at different 
downstream dendrites [HI, [3^]. Fluctuations in mem- 
brane potentials are the primary source of neural vari- 
ability [Z(| [4l| ; the neural architecture is such that this 
synaptic noise is then shared among many downstream 
neurons leading to strong correlations in their sponta- 
neous fluctuations p2^ . 

Work in the theory of computation has, in parallel 
to these experimental discoveries, shown how the failure 
model implied by Eq. [2] is insufficient to address ques- 
tions of reliability when the possibility of randomized 
algorithms are taken into account. Rcf. 3l| describes 



alternatives to the e-independent model, but additional 
work, and richer theories of mechanism, are needed to 
accommodate the kinds of failures that violate Eq. [2] in 
the ways described here. 

The implications of correlated mechanism noise can be 
seen in Fig. [8j which shows the emergence of new group 
structures in the two-letter case described at the begin- 
ning of this section. Plotted on the same scale as Fig. [6l 
it shows how a restricted class of failures can avoid the 
transition to reset-dominance altogether. In particular, 
the existence of only one failure mode, where the circuit 
switches from X0R to N0T-XQR, leads to a random walk 
whose asymptotic limit is the uniform distribution over 
the alternating group A<± (even permutations on four el- 
ements), a subgroup of the full set of permutations. 

The two-letter machine of Fig. [5] provides an excel- 
lent example of the distinction between irreversibility and 
dissipation. No irreversible transformations are ever per- 



formed on the system states; the entropy remains con- 
stant and the system remains in equilibrium. Two peb- 
bles placed on different initial states will never meet. 
However, the possibility of error - which converges to a 
certainty - means that a number of different histories are 
compatible with the present state, even when knowledge 
of the initial state is certain. The history of the organism 
can be decoded only with information about the internal 
states of its Bernoulli process. 



X. CONCLUSIONS 

Effective theories have proven to be a powerful tool for 
the investigation of the physical world; when combined 
with group theoretic arguments, they have allowed for 
principled exploration of phenomena where the under- 
lying mechanisms remain unclear or unknown j43j . We 
have shown here how effective theories can extend to irre- 
versible, dissipative and out-of-equilibrium systems with 
a demonstration that relates an underlying mechanism 
(the Boolean circuits) to a higher-level decomposition 
that permits coarse-graining. 

Irreversibility can occur "by design," when certain en- 
vironmental inputs are taken to be resets by the under- 
lying mechanism. In natural systems, such resets may 
be useful in cases, for example, where radical changes in 
environment invalidate the count, or higher- level group 
property, the machine has arrived at. 

But the related phenomenon of dissipation can also 
occur due to underlying noise in the mechanism. This 
fundamentally limits the lifetime of any particular group 
structure - counts and more complicated memories can 
only be maintained for so long. Even when mechanisms 
are formally "universal" (for example, even when ma- 
chines are assembled from gates in a universal basis), 
noise limits these universal properties, and leads to an 
association between (classes of) underlying mechanisms 
and emergent, effective theories. 

Symmetry groups have played a central role in the 
physical sciences - particularly in the study of effective 
field theories of elementary particles jiiMiq . The pres- 
ence of both irreversibility and dissipation in biological, 
social and even computational 47j systems could poten- 
tially be taken as a sign that these methods will be inef- 
fective in these new realms. 



We find, instead, that such groups still have a role to 
play. When systems have irreversible mechanisms, hid- 
den symmetries can still be found. Even when noise, and 
thus dissipation, is present, these symmetries may sur- 
vive, possibly even in enriched form, on short timescales. 
The planets are confined, by symmetry, to a single orbital 
plane for exceedingly long periods; despite the dissipa- 
tion present, a bird flock may also show patterns, and 
group actions on those patterns, for short times before 
they fluctuate away. 
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FIG. 9. The three-bit left-shift automaton. 



XI. ACKNOWLEDGEMENTS 



I thank Chuck Stevens, Jay Garlapati, Attila Egri- 
Nagy and the attendees of the Santa Fe Institute Com- 
plex Systems Summer School 2011 for helpful conversa- 
tions, and my two anonymous referees for their detailed 
comments and questions. I acknowledge the support of 
an Omidyar Postdoctoral Fellowship and National Sci- 
ence Foundation Grant EF-1137929, "The Small Number 
Limit of Biological Information Processing." 



[1] J. von Neumann, in Automata Studies, edited by C. E. 
Shannon and J. McCarthy (Princeton University Press, 
1956) Edited version of related lectures by Michael 
D. Godfrey, 2010 at |http : //qss . Stanford . edu/~ | 
godf rey/vonNeumarm/. 

[2] L. Glass and S. A. Kauffman, Journal of Theoretical Bi- 
ology, 39, 103 (1973). 

[3] P. W. Anderson, Science, 177, 393 (1972). 

[4] J. Rhodes, Applications of Automata Theory and Algebra, 
edited by C. L. Nehaniv (World Scientific, 2010) edited 
and corrected edition of 1971 text. 

[5] J. P. Crutchfield and K. Young, in Complexity, Entropy 
and the Physics of Information, edited by W. H. Zurek 



XII. APPENDIX 

Here we show the isomorphism between the left-shift 
powerset (LSP) semigroup (on n bits) and the full trans- 
formation semigroup (FTS) (on 2™ elements.) It is not 
immediately obvious that the two semigroups arc isomor- 
phic; the LSP has (up to) 2^ 2 ) generators (one generator 
for each truth table) and the FTS has (2™)( 2 ) elements. 
The FTS has three generators: the cyclic permutation, a 
swap of neighboring elements, and a elementary collaps- 
ing (all elements unchanged, except one element, which 
is mapped to its neighbor.) Only one of these (the cyclic 
permutation) appears in the generators of the LSP. 

We shall show the isomorphism by showing that the 
three generators of the FTS can be found in the elements 
of the LSP. Since the FTS is the maximal semigroup 
possible, inclusion implies isomorphism. The reader may 
want to refer to Fig. [9j generators of the LSP can be 
constructed by choosing one of the two outgoing arrows 
for each node. 

The cyclic permutation is easy to find in 
Fig. [9] - the path for the three-bit case runs 
{000,001,010,101,011,111,110,100,000}. A ma- 
chine associated with this pattern for arbitrary bit 
length is the Linear Feedback Shift Register (LFSR; see 
Ref. [i^.) The maximal LFSR relies solely on X0R to 
produce cycles over 2" — 1 states (skipping the all-zero 
state), but any particular case can be augmented (using 
non-standard gates) to cycle over the full 2" states. 

Call the 2" cycle a, and the 2" - 1 cycle b. The two 
cycles can then be composed to produce a pair-swap - in 
particular, b^ 2 ~ 2 'a compose to make a pairwise swap of 
the first two elements. Since the LSP includes the cyclic 
permutation and the pair-swap, it includes the symmetric 
group. 

It remains to show that the LSP includes an elemen- 
tary collapsing. The cyclic permutation a must include 
the transition 00... — > 00... 1; if we change this to 
00 ... — > 00 ... 0, yielding another element of the LSP, 
then we have (after multiplying by a^ 2 an elemen- 
tary collapse, and the proof of correspondence is com- 
plete. 



(Addison-Wesley, 1989) p. 223. 

[6] S. Bonn and E. E. M. Furlong, Curr Opin Genet Dev, 
18, 513 (2008). 

[7] E. H. Davidson, J. P. Rast, P. Oliveri, A. Ransick, 
C. Calestani, C.-H. Yuh, T. Minokawa, G. Amore, 
V. Hinman, C. Arenas-Mena, O. Otim, C. T. Brown, 
C. B. Livi, P. Y. Lee, R. Revilla, M. J. Schilstra, P. J. C. 
Clarke, A. G. Rust, Z. Pan, M. I. Arnone, L. Rowen, 
R. A. Cameron, D. R. McClay, L. Hood, and H. Bolouri, 
Dev Biol, 246, 162 (2002). 

[8] E. H. Davidson, Developmental Biology, 357, 35 (2011). 

[9] J. Maci'a, S. Widder, and R. Sole, J Theor Biol, 261, 
126 (2009). 



11 



[10] E. L. Post, Bull. AMS, 26, 437 (1920). 

[11] D. Lau, Function Algebras on Finite Sets: a Ba- 
sic Course on Many-Valued Logic and Clone Theory, 
Springer Monographs in Mathematics (Springer, 2006). 

[12] J. Pearl, Causa litu (Cambridge University Press. 2009) 

[13] J. Dassow, in Structural Theory of Automata, Semi 



groups, and Universal Algebra, NATO Science Series, 
Vol. 207, edited by V. Kudryavtsev, I. Rosenberg, and 
M. Goldstein (Springer Netherlands, 2005) pp. 77-108. 
[14] J. Dassow, Completeness Problems in the Structural The- 
ory of Automata (Akademie-Verlag, Berlin, 1981). 
[15] N. Pippenger, Theories of Computability (Cambridge 

University Press, 1996). 
[16] We use the word 'deterministic' in the automata sense 
- i.e., a deterministic system is such that a letter-state 
pair is associated with a unique transition, 5 : E x Q — > Q 
as opposed to S : E x Q — > Powerset [Q] . We do not con- 
sider non-deterministic automata explicitly in this paper; 
well-known methods allow one to construct a determin- 
istic automata corresponding to any non-deterministic 
one. We use the word 'probabilistic' to refer to situations 
in which a deterministic transition is chosen from a set 
probabilistically. 
[17] As with 'non-deterministic' and 'probabilistic,' it is worth 
distinguishing 'irreversible' and 'dissipative'. Irreversibil- 
ity need not be associated with any randomness, and 
can be a consequence of a completely non-probabilistic 
map, such as an irreversible computation that deletes 
input. Dissipation, by contrast, we associate with pro- 
cesses that can not be run backwards because different 
histories have been merged due to an ignorance of which 
randomly-chosen operation was performed. We return to 
this distinction at the end of Sec. IIXI 
[18] For clarity, we do not include the transitory and 1 states 

in our automata pictures. 
[19] A related notion is that of one machine "pre-processing" 
the environment and handing off its output to the next 
machine - this turns out to be equivalent to the descrip- 
tion we use here, but harder to formulate in terms of our 
finite state automata. 
[20] K. Krohn and J. L. Rhodes, Transactions of the American 

Mathematical Society, 116, 450 (1965). 
[21] Homomorphic behavior means that there exists a map 
between the two semigroups that preserves multipli- 
cation. There is a homomorphic mapping 4> between 



[22 
[23 



[24 
[25 



[26 

[27 

[28 

[29 

[30 

[31 
[32 

[33 
[34 

[35 
[36 

[37 
[38 

[39 
[40 
[41 

[42 

[43 
[44 
[45 
[46 



two groups in the case that multiplication is preserved: 
4>{a) ■ 4>{b) = 4>(a ■ b). Homomorphic mappings need not [47 
one-to-one, and in general the cascade will be larger than 
the original machine; in particular, the mapping may [48 



need to be restricted to a subautomaton of the cascade, 
and some states within this subautomaton may need to 
be identified with each other. 

S. Eilenberg, Automata, Languages, and Machines, 
Vol. B (Academic Press, 1976). 

W. Holcombe, Algebraic Automata Theory, Cambridge 
Studies in Advanced Mathematics (Cambridge Univer- 
sity Press, 1982) Chap. 4. 

C. Nehaniv and J. Rhodes, Artificial Life, 6, 45 (2000). 

O. Maler, in Time for Verification: Essays in Memory 

of Amir Pnueli, edited by Z. Manna and D. A. Peled 

(Springer, 2010) pp. 260-278, ISBN 978-3-642-13753-2. 

A. Egri-Nagy and C. L. Nehaniv, 

sgpdec - software package for hierarchical coordmatization of groups 

(2011). 

A. Egri-Nagy and C. L. Nehaniv, Artificial Life, 14, 299 
(2008). 

A. Egri-Nagy and C. L. Neh aniv, ArXiv e-prints (2009), 

| arXiv:0911.5433 [math.GRJI 

GAP - Groups, Algorithms, and Programming, Version 4-4-12 
The GAP Group (2008). 

O. Maler, Theoretical Computer Science, 145, 391 
(1995). 

N. Pippenger, |journal of the ACM, 36, 531 (1989). 



D. C. Krakauer and A. Sasaki, Proc Biol Sci, 269, 2423 
(2002). 

C. Rao and D. Wolf, Nature, 420, 231 (2002). 

G. Siiel, R. Kulkarni, J. Dworkin, and J. Garcia- Ojalvo, 

Science, 315, 1716 (2007). 

B. Lehner, Molecular Systems Biology, 4, 170 (2008). 
A. Bar-Even, J. Paulsson, N. Maheshri, and M. Carmi, 
Nature Genetics, 38, 636 (2006). 

G. Hornung, PLoS Computational Biology, 4, e8 (2008). 

H. Jia, N. Rochefort, X. Chen, and A. Konnerth, Nature, 
464, 1307 (2010). 

N. J. Priebe and D. Ferster, Nature, 464, 1290 (2010). 
W. H. Calvin and C. F. Stevens, Science, 155, 842 (1967). 
W. H. Calvin and C. F. Stevens, J Neurophysiol, 31, 574 
(1968). 

I. Lampl, I. Reichova, and D. Ferster, Neuron, 22, 361 
(1999) 



N. Huggett and R. Weingard, Bvnthcsc. 102, 171 (1995) 



S. Weinberg, |Physica A, 96, 327 (1979) . 

J. Polchins ki. Nuclear Physics B. 231. 269 (1984). 



H. Georgi, Annual Review of Nuclear and Particle Sci- 



ences, 43, 209 (1993) 



C. H. Bennett, International Journal of Theoretical 
Physics, 21, 905 (1982). 

B. Schneier, Applied Cryptography (John Wiley & Sons, 
1996) Chap. 16. 



